Accelerating federated learning via momentum gradient descent

Federated learning (FL) provides a communication-efficient approach to solve machine learning problems concerning distributed data, without sending raw data to a central server. However, existing works on FL only utilize first-order gradient descent (GD) and do not consider the preceding iterations to gradient update which can potentially accelerate convergence. In this article, we consider momentum term which relates to the last iteration. The proposed momentum federated learning (MFL) uses momentum gradient descent (MGD) in the local update step of FL system. We establish global convergence properties of MFL and derive an upper bound on MFL convergence rate. Comparing the upper bounds on MFL and FL convergence rates, we provide conditions in which MFL accelerates the convergence. For different machine learning models, the convergence performance of MFL is evaluated based on experiments with MNIST and CIFAR-10 datasets. Simulation results confirm that MFL is globally convergent and further reveal significant convergence improvement over FL

Maritime coverage enhancement using UAVs coordinated with hybrid satellite-terrestrial networks

Due to the agile maneuverability, unmanned aerial vehicles (UAVs) have shown great promise for on-demand communications. In practice, UAV-aided aerial base stations are not separate. Instead, they rely on existing satellites/terrestrial systems for spectrum sharing and efficient backhaul. In this case, how to coordinate satellites, UAVs and terrestrial systems is still an open issue. In this paper, we deploy UAVs for coverage enhancement of a hybrid satellite-terrestrial maritime communication network. Using a typical composite channel model including both large-scale and small-scale fading, the UAV trajectory and in-flight transmit power are jointly optimized, subject to constraints on UAV kinematics, tolerable interference, backhaul, and the total energy of the UAV for communications. Different from existing studies, only the location-dependent large-scale channel state information (CSI) is assumed available, because it is difficult to obtain the small-scale CSI before takeoff in practice and the ship positions can be obtained via the dedicated maritime Automatic Identification System. The optimization problem is non-convex. We solve it by using problem decomposition, successive convex optimization and bisection searching tools. Simulation results demonstrate that the UAV fits well with existing satellite and terrestrial systems, using the proposed optimization framework

Passive detection of moving aerial target based on multiple collaborative GPS satellites

Passive localization is an important part of intelligent surveillance in security and emergency applications. Nowadays, Global Navigation Satellite Systems (GNSSs) have been widely deployed. As a result, the satellite signal receiver may receive multiple GPS signals simultaneously, incurring echo signal detection failure. Therefore, in this paper, a passive method leveraging signals from multiple GPS satellites is proposed for moving aerial target detection. In passive detection, the first challenge is the interference caused by multiple GPS signals transmitted upon the same spectrum resources. To address this issue, successive interference cancellation (SIC) is utilized to separate and reconstruct multiple GPS signals on the reference channel. Moreover, on the monitoring channel, direct wave and multi-path interference are eliminated by extensive cancellation algorithm (ECA). After interference from multiple GPS signals is suppressed, the cycle cross ambiguity function (CCAF) of the signal on the monitoring channel is calculated and coordinate transformation method is adopted to map multiple groups of different time delay-Doppler spectrum into the distance−velocity spectrum. The detection statistics are calculated by the superposition of multiple groups of distance-velocity spectrum. Finally, the echo signal is detected based on a properly defined adaptive detection threshold. Simulation results demonstrate the effectiveness of our proposed method. They show that the detection probability of our proposed method can reach 99%, when the echo signal signal-to-noise ratio (SNR) is only −64 dB. Moreover, our proposed method can achieve 5 dB improvement over the detection method using a single GPS satellite

Using heterogeneous satellites for passive detection of moving aerial target

Passive detection of a moving aerial target is critical for intelligent surveillance. Its implementation can use signals transmitted from satellites. Nowadays, various types of satellites co-exist which can be used for passive detection. As a result, a satellite signal receiver may receive signals from multiple heterogeneous satellites, causing difficult in echo signal detection. In this paper, a passive moving aerial target detection method leveraging signals from multiple heterogeneous satellites is proposed. In the proposed method, a plurality of direct wave signals is separated in a reference channel first. Then, an adaptive filter with normalized least-mean-square (NLMS) is adopted to suppress direct-path interference (DPI) and multi-path interference (MPI) in a surveillance channel. Next, the maximum values of the cross ambiguity function (CAF) and the fourth order cyclic cumulants cross ambiguity function (FOCCCAF) correspond into each separated direct wave signal and echo signal will be utilized as the detection statistic of each distributed sensor. Finally, final detection probabilities are calculated by decision fusion based on results from distributed sensors. To evaluate the performance of the proposed method, extensive simulation studies are conducted. The corresponding simulation results show that the proposed fusion detection method can significantly improve the reliability of moving aerial target detection using multiple heterogeneous satellites. Moveover, we also show that the proposed detection method is able to significantly improve the detection performance by using multiple collaborative heterogeneous satellites

Robust federated learning with noisy communication

Federated learning is a communication-efficient training process that alternate between local training at the edge devices and averaging of the updated local model at the center server. Nevertheless, it is impractical to achieve perfect acquisition of the local models in wireless communication due to the noise, which also brings serious effect on federated learning. To tackle this challenge in this paper, we propose a robust design for federated learning to decline the effect of noise. Considering the noise in two aforementioned steps, we first formulate the training problem as a parallel optimization for each node under the expectation-based model and worst-case model. Due to the non-convexity of the problem, regularizer approximation method is proposed to make it tractable. Regarding the worst-case model, we utilize the sampling-based successive convex approximation algorithm to develop a feasible training scheme to tackle the unavailable maxima or minima noise condition and the non-convex issue of the objective function. Furthermore, the convergence rates of both new designs are analyzed from a theoretical point of view. Finally, the improvement of prediction accuracy and the reduction of loss function value are demonstrated via simulation for the proposed designs